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Abstract 


Federal  Acquisition  Reform  has  consistently  called  for  more  and  better 
collaboration  among  participating  organizations.  Experience  shows,  however,  that 
inter-organizational  collaboration  can  be  difficult  at  best.  Our  research  focuses  on 
imperatives  of  successful  collaboration  and  aims  to  assist  organizations  in 
diagnosing  their  collaborative  capacity.  Based  on  prior  research  with  homeland 
security  organizations,  we  offer  a  model  of  inter-organizational  collaborative  capacity 
grounded  in  a  systems  perspective.  We  then  identify  enablers  and  barriers  that 
contribute  to  collaborative  capacity.  A  diagnostic  process  based  on  the  established 
practices  of  organization  development  is  offered  to  guide  the  design  of  tailored 
assessments  of  collaborative  capacity.  We  present  a  comprehensive  set  of  both 
interview  and  survey  questions,  based  on  our  model,  which  can  be  used  in  creating 
a  collaborative  capacity  audit.  The  ability  to  diagnose  collaborative  capacity 
encourages  literacy  around  collaboration  and  assists  leaders  in  determining 
mechanisms  for  developing  their  organization’s  collaborative  capacity.  Finally,  we 
describe  the  future  plans  for  validating  these  assessment  tools. 

Keywords:  interagency  collaboration;  inter-organizational  collaboration; 
collaborative  capacity 
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Introduction 


Complex  interagency^  collaboration  is  characterized  by  high  task  uncertainty, 
multiple  participants,  virtual  communication  and  diverse  organizational  goals.  As 
organizations  increase  their  dependence  on  one  another  and  attempt  to  increase 
their  performance,  interagency  collaboration  is  viewed  by  many  as  an  imperative.  In 
the  federal  government,  for  instance,  the  Federal  Acquisition  Reform  has 
consistently  called  for  more  and  better  collaboration  among  participating 
organizations.  Partnering,  Alpha  Contracting,  Integrated  Product  Teams,  and  Delta 
Contracting  are  but  a  few  examples  of  innovative  arrangements  that  currently  are 
being  used  to  increase  interagency  collaboration  among  agencies. 

In  government  and  industry,  collaboration  is  on  the  rise  because  it  has  been 
found  to  reduce  litigation,  decrease  costs,  and  increase  innovation  (Mankin,  Cohen 
&  Fitzgerald,  2004).  Accordingly,  some  organizations  have  developed  mature 
partnering  arrangements  or  alliances  and  have  demonstrated  that  these 
arrangements  can  significantly  reduce  cycle-time  and  save  millions  of  dollars.  Other 
organizations  have  not  yet  positioned  themselves  to  leverage  the  benefits  of 
collaborative  relationships. 

Our  research  focuses  on  imperatives  of  successful  collaboration  and  aims  to 
assist  organizations  in  diagnosing  their  collaborative  capacity.  Diagnosing 
collaborative  capacity  encourages  literacy  around  collaboration  and  assists  leaders 
in  determining  capabilities  that  the  organization  must  develop  to  be  successful.  This 
paper  describes  what  we  mean  by  the  term  “collaborative  capacity,”  explains  key 
factors  for  successful  collaboration,  and  shows  how  our  diagnostic  tool  can  leverage 
learning  for  an  organization. 


^  “Inter-organizational”  can  be  substituted  for  “interagency”  when  referring  to  private/public-sector 
partnerships. 
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What  is  Collaborative  Capacity? 

Collaborative  capacity,  as  it  relates  to  interagency  collaboration,  resonates  in 
the  work  of  a  number  of  academics  and  practitioners  (e.g.,  Bardach,  1998;  Huxham, 
1996;  Mowery,  Oxley  &  Silverman,  1996;  Seidman,  1970).  Collaborative  capacity  is 
the  ability  of  organizations  to  enter  into,  develop,  and  sustain  inter-organizational 
systems  in  pursuit  of  collective  outcomes.  A  capacity  for  collaboration  enhances  the 
probability  of  mission  completion  by  leveraging  dispersed  resources.  The  benefits  of 
developing  collaborative  capabilities  include:  cost  savings  through  the  transfer  of 
smart  practices,  better  decision  making  as  a  result  of  advice  and  information 
obtained  from  colleagues,  enhanced  capacity  for  collective  action  by  dispersed  units, 
and  innovation  through  the  cross-pollination  of  ideas  and  recombination  of  scarce 
resources  (Hansen  &  Nohria,  2004). 

When  is  Collaboration  Most  Beneficial? 

Collaboration  is  most  beneficial  when  organizations  are  interdependent  and 
rely  on  each  other  to  achieve  a  common  goal  or  task.  This  reliance  provides  an 
opportunity  for  organizations  to  coordinate  their  work  and  find  ways  to  work  well  with 
one  another.  While  collaboration  appears  on  the  surface  to  be  an  obvious  solution, 
experience  shows  that  organizations  commonly  fail  when  they  attempt  to  build 
collaborative  relationships.  Among  the  reasons  for  ineffective  collaboration  are: 
diverse  missions,  goals  and  incentives  that  conflict  with  one  another;  histories  of 
distrust  that  are  hard  to  alter;  leaders  who  do  not  actively  support  collaborative 
efforts;  and  the  lack  of  coordination  systems  and  structures  needed  to  support 
collaborative  efforts  (US  Government  Accountability  Office,  2002,  December). 
Hurricane  Katrina  relief  was  a  dramatic  example  of  the  consequences  of  failed 
collaborative  efforts. 

Relevance  of  Collaborative  Capacity  to  Acquisition 

Acquisition  Reform  initiatives  have  consistently  called  for  more  and  better 
collaboration  among  participating  acquisition  agencies  as  well  as  between  the  DoD 
and  defense  contractors.  Specifically,  the  DoD  Directive  5000.1  (The  Defense 
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Acquisition  System,  paragraph  E1.2,  Collaboration,  2003)  points  out  that  “DoD 
acquisition,  capabilities,  and  financial  communities,  and  operational  users  shall 
maintain  continuous  and  effective  communications  with  each  other  by  using  IPTs.” 

In  addition,  DoD  5000.1  states  that  teaming  among  warfighters,  users,  developers, 
acquirers,  technologists,  testers,  budgeters,  and  sustainers  shall  begin  during  the 
capability  needs  definition  phase  of  the  acquisition  lifecycle.  Furthermore,  the  recent 
Defense  Acquisition  Performance  Assessment  (DAPA)  report  recommends 
improved  collaboration  among  acquisition  organizations  as  well  as  between  the  DoD 
and  industry  (Deputy  Secretary  of  Defense,  2006).  As  DAPA  recommendations  are 
implemented,  additional  collaboration  requirements  and  opportunities  will  emerge. 

Goal  of  this  Research 

The  focus  of  this  phase  of  the  research  project  is  the  development  of  a 
collaboration-readiness  assessment.  This  instrument  will  allow  organizations  to 
assess  their  capacity  to  engage  in  collaborative  efforts  and  then  provide  specific 
activities  for  improving  their  collaborative  capacity. 
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Collaborative  Capacity  Model 


Our  Previous  Interagency  Research 

The  first  phase  of  our  research  employed  a  semi-inductive  method  where  we 
conducted  two  studies  with  senior  leaders  in  the  Department  of  Homeland  Security 
(DHS)  to  learn  more  about  organizations’  collaborative  capacity  during  the  early 
planning  stages.  In  Study  One,  we  used  an  inter-organizational  systems  perspective 
to  identify  factors  that  create  or  deter  effective  collaboration.  Study  Two  elicited 
vignettes  from  a  second  group  of  DHS  leaders  to  gain  further  insights  into  the  ways 
in  which  their  organizations  are  successfully  building  collaborative  capacity. 

Enablers  and  Barriers  to  Developing  Interagency  Collaboration 

Our  study  of  senior  leaders  in  homeland  security  identified  key  factors  that 
explain  success  (enablers)  and  barriers  to  interagency  collaboration  (see  Figure  1) 
(Hocevar,  Thomas  &  Jansen,  2004).  The  left-hand  column  names  the  organization 
design  component  as  identified  in  our  systems  model  above.  The  column  identified 
as  “driving  forces”  lists  the  factors  that  contribute  most  to  successful  interagency 
collaboration.  The  column  identified  as  “restraining  forces”  includes  the  factors  that 
impede  collaboration. 

Our  analysis  uses  Lewin’s  “force  field”  analysis  model  which  was  developed 
over  50  years  ago  and  is  still  viewed  as  the  prominent  way  of  explaining  the  forces 
of  a  change  process  (McShane  &  Van  Glinow,  2005).  In  this  case,  the  model 
provides  a  framework  for  examining  the  enablers  and  barriers  to  developing 
interagency  collaboration  and  demonstrates  how  driving  forces  and  restraining 
forces  work  to  maintain  an  equilibrium  or  status  quo  effect.  If  an  organization 
chooses  to  increase  its  collaborative  capacity,  it  must  create  a  condition  where  the 
driving  forces  are  stronger  than  the  restraining  forces.  This  would  mean  that  the 
driving  forces  must  be  strengthened  and/or  the  restraining  forces  must  be  weakened 
or  removed. 
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Figure  1.  Force-field  Analysis  for  Building  Collaborative  Capacity 
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organizations 

-  Divergent  goals 

-  Focus  on  local  organization 
over  cross-agency  (e.g., 
regional)  concerns 

-  Lack  of  goal  clarity 

-  Not  adaptable  to  interests  of 
other  organizations 
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participants 
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networks) 
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Enablers  to  Success 

“Purpose  and  strategy”  can  be  driven  by  a  commonly  perceived  risk  or  threat 
(“felt  need”)  or  a  common  goal  such  as  improving  information  sharing  or  coordinated 
training.  Accomplishing  a  shared  purpose  is  enabled  by  the  third  factor  in  this 
category — the  willingness  to  adapt  the  collaborative  effort  to  the  needs  and  interests 
of  other  participating  organizations. 

The  “structural”  component  includes  the  formal  power  and  authority  of  those 
engaged  in  an  interagency  collaboration.  We  found  that  successful  interagency 
collaborations  had  formalized  coordination  of  liaison  roles,  and  players  had  sufficient 
authority. 

“Lateral  Mechanisms”  are  another  factor  that  contributes  to  success.  Social 
capital  represents  the  interpersonal  trust  and  exchange  orientations  that  come  from 
human  interaction,  which  provides  an  important  foundation  for  civic  behavior  (e.g., 
Adler  &  Kwon,  2002;  Putnam,  2000).  We  classified  social  capital  as  a  lateral 
mechanism  within  the  organization  design  framework.  Effective  communication  also 
was  identified  as  a  related  lateral  mechanism.  Some  characterizations  of  effective 
communication  include:  timely  dissemination  of  information,  free  flow  of  information, 
and  the  establishment  of  communications  systems  and  processes  across 
organizations.  Effective  communication,  along  with  the  increased  familiarity  that 
comes  with  interpersonal  networks,  provides  an  important  means  for  collaboration. 

In  addition  to  human  communication,  technical  interoperability  contributes  to 
success. 

“Incentives”  was  the  fourth  category  of  success  factors.  In  our  study, 
collaboration  often  was  a  prerequisite  for  obtaining  resources.  For  instance, 
agencies  might  be  required  to  develop  a  multi-agency  coalition  in  order  to  receive  a 
grant.  While  this  does  not  guarantee  success,  it  creates  an  opportunity  to  develop 
other  important  collaborative  capabilities.  Collaborating  in  the  development  of  a 
grant  proposal  is  a  focused,  time-limited  activity  with  clearly  identified  “payoffs.”  The 
process  of  this  effort  can  generate  a  better  understanding  of  other  organizations’ 
interests  and  capabilities,  create  social  capital  as  interpersonal  relationships  are 
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developed,  and  set  the  stage  for  the  creation  of  temporary  or  permanent  structures 
for  collaboration  and  information  exchange.  Incentives  to  collaborate  can  be 
achieved  through  mandates  or  external  requirements  for  funding  (Cummings,  1984). 
Another  incentive  to  collaborate  is  strong  leadership.  A  leader  who  clearly 
expresses  commitment  to  a  vision  of  collaboration  with  other  agencies  can  provide 
an  important  incentive  for  other  organizational  members  to  engage  in  this  “new” 
activity.  This  is  similar  to  the  acknowledged  role  of  leadership  in  effective  change 
management  (e.g.,  Kotter,  1990).  Other  success  imperatives  included  an  absence 
of  competitive  rivalries  and  an  acknowledgement  of  the  benefits  of  collaborative 
efforts. 


The  last  category  of  success  factors  is  “People.”  A  primary  characteristic  of 
those  who  participate  in  successful  collaborative  efforts  is  an  appreciation  of  others’ 
perspectives.  In  other  words,  players  are  able  to  step  outside  their  own  narrow 
interests  and  appreciate  other’s  views.  Successful  players  develop  competencies 
for  collaboration  and  are  able  to  build  trust  among  the  various  players.  Commitment 
and  motivation  are  also  keys  to  success. 

Barriers  to  Collaboration 

Barriers  to  collaboration  substantially  reinforce  the  factors  identified  as 
contributing  to  success,  even  though  they  are  not  an  exact  replication  of  the 
capabilities  described  above. 

Under  “Purpose  and  Strategy,”  divergent  goals  impede  interagency 
collaboration.  Related  to  that  is  a  lack  of  goal  clarity.  Opposed  to  the  earlier 
success  factor  of  recognizing  other’s  interests,  barriers  arise  when  players  focus  on 
their  own  organization’s  interests  at  the  expense  of  a  broader  set  of  interests  or  a 
common  goal.  Even  when  others’  interests  are  recognized,  the  unwillingness  or 
inability  to  adapt  to  interests  of  the  other  organizations  is  another  barrier. 

While  mentioned  less  frequently,  other  barriers  to  effective  interagency 
collaboration  are  classified  as  Structural.  Specific  examples  include:  procedural 
prohibitions  such  as  security  classifications,  lack  of  formal  roles  and  procedures  to 
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enable  collaboration,  inadequate  authority  of  participants  to  engage  in  negotiation  or 
decision-making  on  behalf  of  their  organization,  and  lack  of  accountability.  Most  of 
these  are  indicators  of  problems  that  can  exist  in  “under-designed”  systems 
(Cummings,  1984).  Because  well-established,  institutional  mechanisms  for 
coordination  are  unlikely  to  exist  or  are  likely  to  be  underdeveloped  in  extra- 
organizational  relationships,  the  importance  of  leadership,  followership,  and 
colleagueship  (i.e.,  the  capacity  for  mutual  adjustment)  is  increased. 

Two  barriers  identified  in  the  category  of  “Lateral  Mechanisms”  are  “Lack  of 
familiarity  with  other  organizations”  and  “Inadequate  communication  and  information 
sharing”  which  both  represent  missing  enablers  of  collaboration.  Some  participants 
identified  distrust  as  a  cause  of  inadequate  communication.  Distrust  is  sometimes 
characterized  at  the  organizational  level,  as  in  “the  organizations  have  a  history  of 
distrust.”  As  an  organization-level  phenomenon,  we  also  view  this  as  a  disincentive 
to  collaboration  and,  thus,  categorized  this  factor  as  a  barrier  under  “Incentives.” 
Other  times,  the  participants  attributed  distrust  to  individuals;  in  this  case,  we 
categorized  the  factor  into  the  design  dimension  of  “People.”  Behaviors  that  are 
both  instigators  and  symptoms  of  distrust  included  “Arrogance,  hostility,  and 
animosity”  in  the  People  category  and  “Lack  of  mutual  respect”  when  attributed  to 
organizations  (in  the  Incentives  category). 

Two  other  frequently  cited  barriers  were  “Competition  for  resources”  and 
“Territoriality  and  turf  protection.”  These  two  factors  were  categorized  as 
(dis)incentives.  These  factors  are  related  to  the  Lateral  Mechanisms  and  People 
factors  described  above.  While  the  causal  relationship  is  not  definitive,  a  clear 
relationship  exists  among  competition/territoriality  and  lack  of  familiarity,  inadequate 
communication,  and  distrust.  Together,  these  system  dimensions  can  create  a 
continuing  cycle  of  dysfunction.  When  organizations  are  competitive,  distrustful,  or 
just  unfamiliar  with  each  other,  this  can  impede  necessary  communications.  The 
inadequacy  of  communications,  in  turn,  continues  the  lack  of  familiarity,  or  in  the 
more  extreme  cases,  can  increase  distrust.  This  suggests  that  specific  interventions 
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to  disrupt  this  cycle  and  shift  the  alignment  toward  constructive  interactions  are 
necessary  to  build  collaborative  capacity. 

Model  of  Collaborative  Capacity 

Drawing  on  relevant  literature  and  other  experts  in  the  field,  we  deductively 
developed  a  framework  to  map  the  conditions  for  effective  interagency  collaboration. 
We  try  to  capture  the  dynamic  interaction  among  all  of  these  factors  in  the  image 
presented  in  Figure  2.  This  diagram  shows  two  organizations  (A  and  B)  facing  a 
problem  in  which  they  have  some  interdependent  interest  or  responsibility.  Each 
organization  can  be  represented  in  terms  of  the  five  organization  design  components 
derived  from  Galbraith  (2002).  The  arrows  indicate  the  dynamic  interaction  among 
the  system  elements  both  within  and  between  organizations  as  they  contribute  to  the 
collaborative  capability  to  meet  interagency  goals. 

The  dynamic  interactions  occur  in  at  least  three  domains.  First,  effective 
collaborative  capacity  requires  that  the  five  system  design  categories  (Strategy, 
Structure,  Incentives,  Lateral  Mechanisms  and  People)  for  each  participating 
organization  be  aligned  with  each  other  and  with  the  environmental  requirement  or 
challenge  (cf.  Nadler  &  Tushman,  1980).  This  is  reflected  in  the  arrows  within  each 
of  the  three  pentagons.  However,  because  the  problem  assumes  interdependence 
among  multiple  organizations,  developing  collaborative  capacity  cannot  be 
accomplished  by  focusing  solely  on  the  dynamics  within  each  organization. 
Alignment  also  needs  to  occur  among  the  system  elements  across  organizations. 
Finally,  temporary  or  permanent  interagency  structures  are  frequently  established  to 
better  enable  the  collaborative  response  to  the  common  problem.  In  such  a  case,  a 
third  domain  of  interaction  needs  to  be  developed  so  that  the  design  characteristics 
of  the  interagency  task  force  or  team  are  not  only  internally  consistent,  but  also  are 
aligned  with  the  primary  organizations  they  represent  (Hocevar,  Thomas  &  Jansen, 
2006). 
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Figure  2.  Developing  Organization  Design  Dynamics  to  Improve  Collaborative 
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Diagnosing  Collaborative  Capacity  as  an 
Organization  Development  Process 


Rationale  for  Diagnosis 

We  have  shaped  the  process  presented  here  for  using  the  collaborative 
capacity  readiness  assessment  around  the  well-established  principles  of 
organization  development.  According  to  Beckhard  (1969),  organization 
development  (OD)  is  a  planned  effort  of  systematic  diagnosis  involving  the  whole 
system  (i.e.,  structures  and  processes  at  different  levels  of  the  organization)  with  the 
goal  of  using  the  diagnostic  data  to  improve  organizational  effectiveness.  The 
specific  effectiveness  goals  for  OD  can  be  wide-ranging.  But,  in  the  case  of  this 
project,  the  diagnostic  focuses  on  improving  interagency  collaboration. 

The  diagnostic  process  can  inform  and  enable  organizational  change  in  many 
ways.  First,  theoretical  models  and  prior  research  are  used  to  design  the  diagnostic 
tools  (e.g.,  French  &  Bell,  1999;  Flarrison,  1994).  This  insures  that  the  measurement 
instruments  incorporate  key  variables  known  to  relate  to  the  change  area  of  interest. 
Many  OD  diagnostics  are  structured  around  a  systems  model  (see,  e.g.,  Burke, 

1992;  Weisbord,  1976)  to  provide  a  conceptual  framework  for  the  instrument  design 
and  analysis.  Similarly,  the  model  used  for  this  project  roughly  follows  the  “star 
model”  of  Jay  Galbraith  (2002)  (See  Figure  2).  But  other  models,  such  as 
Weisbord’s  Six  Box  Model  contain  similar  dimensions:  Purposes,  Structure, 
Rewards,  Mechanisms  (i.e.,  coordinating  technologies).  Relationships  (e.g.,  conflict 
management),  and  Leadership  (French  &  Bell,  1999);  these  provide  further 
conceptual  validation  for  the  diagnostic  instrumentation  presented  in  this  report. 

The  second  way  in  which  the  diagnostic  process  can  guide  and  enable 
organizational  change  is  through  a  “gap”  analysis  (e.g.,  Flarrison,  1994).  In 
consultation  with  the  client  organization(s),  the  diagnostic  process  identifies  the 
desired  future  state — why  change  is  needed  and  ways  in  which  improvements  will 
be  demonstrated.  The  assessment  tools  are  tailored  to  the  particular  interests  and 
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requirements  of  the  participating  organization(s).  Data  are  then  gathered  to  assess 
the  “current  state”  of  the  organization  (or  system  of  organizations).  This  assessment 
should  not  just  focus  on  problem  areas  (deficits)  that  need  to  be  addressed,  but  also 
on  potential  assets  and  capabilities  that  can  enable  the  desired  changes. 

The  gaps  between  the  desired  future  and  the  current  state  assessment  are 
used  to  identify  potential  intervention  options  and  develop  specific  action  plans.  The 
initial  assessment  establishes  a  baseline  that  can  be  used  to  evaluate  progress 
toward  the  desired  goals  after  the  implementation  of  interventions.  The  assessment 
also  allows  the  opportunity  for  comparisons  across  organizational  levels  and  units. 
For  example,  it  may  be  worthwhile  to  investigate  the  extent  to  which  top-level 
managers’  assessment  of  collaborative  capacity  is  similar  to  those  of  front-line 
workers.  Also  of  interest  could  be  a  comparison  of  those  whose  work  involves  them 
with  counterparts  in  other  organizations/agencies  with  those  who  have  less  frequent 
contact.  These  analyses  can  inform  the  appropriate  interventions  for  improving 
collaborative  capacity. 

In  addition  to  the  aforementioned  benefits  of  systematic  diagnosis,  the 
process  itself  can  be  an  intervention.  For  example,  organizational  members  become 
sensitized  to  the  importance  of  the  issues  being  assessed  (Downs  &  Adrian,  2004). 
An  organization’s  investment  in  and  commitment  to  an  assessment  of  collaborative 
capability  would  indicate  that  these  are  important  goals  and  valued  activities.  This, 
in  turn,  could  increase  organization  members’  motivation  toward  these  goals  and 
activities.  The  motivation  might  be  intrinsic  due  to  the  heightened  appreciation  for 
the  meaningfulness  of  interagency  collaboration.  The  motivation  might  also  be  the 
result  of  an  increased  expectation  that  there  will  be  extrinsic  rewards  (e.g.,  career 
advancement  opportunities)  to  those  who  increase  their  engagement  in  ways  to 
improve  effective  collaboration  (Nadler,  1977). 

The  diagnostic  process  is  also  a  mechanism  for  organizational  learning. 
Assuming  the  results  are  shared  within  the  organization,  the  data  allow  for  self- 
evaluation  by  members.  Behavior  becomes  more  observable  due  to  the  framing  and 
focus  offered  by  specific  questions  (Nadler,  1977).  Downs  and  Adrian  (2004) 
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describe  the  importance  of  creating  a  language  for  members  to  discuss 
collaboration.  Senge  (1992)  emphasizes  the  value  of  the  diagnosis  in  “catalyzing 
systems  thinking.”  A  significant  step  forward  can  be  gained  by  organizational 
members  thinking  about  how  to  respond  to  questions  about  the  interests  of  potential 
(or  current)  collaboration  partners,  how  their  capabilities  can  enhance  “our” 
organizational  performance,  and  what  barriers  and  opportunities  influence  “our” 
current  practice  of  collaboration. 

The  questions  included  in  the  diagnostic  provide  new  lenses  or  a  more 
specifically  defined  way  of  describing  current  collaboration  and  desired  collaboration. 
Thus,  the  language  and  terminology  of  questions  provide  another  mechanism  for 
learning,  sharpening  thinking  about  collaboration,  and  guiding  actions  to  improve 
collaborative  capacity.  We  often  function  on  the  basis  of  mental  models  comprised 
of  generalizations  or  stereotypes  (Senge,  1992).  The  diagnostic  process  provides  a 
feedback  loop  that  can  challenge  these  mental  models  and  help  refine  and 
reformulate  those  models  based  on  valid  data  rather  than  on  assumptions  that  often 
are  unfounded  or  exaggerated. 

Process  for  Organizational  Diagnosis 

According  to  Harrison  (1994),  an  organizational  diagnosis  has  three  facets: 

1)  Process:  a  diagnostic  plan  to  be  designed  with  input  from 
participating  organization(s); 

2)  Interpretation:  identification  of  specific  mechanisms  for  analyzing 
findings,  providing  feedback,  and  enabling  action  planning; 

3)  Methods:  the  tools  and  techniques  for  gathering  and  analyzing 
diagnostic  data. 

The  specific  tools  (i.e..  Methods)  for  diagnosing  collaborative  capacity  are  described 
in  the  section  below  entitled  “Collaborative  Capacity  Audit”  and  presented  in  detail  in 
Appendix  A.  The  remainder  of  this  section  focuses  on  initiating  and  implementing  a 
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diagnostic  process  to  include  the  design  of  a  tailored  plan  for  data  gathering, 
feedback,  and  action  planning. 

Initiation  Process 

“Initiation”  is  the  first  phase  (e.g..  Downs  &  Adrian,  2004).  This  can  be  self- 
directed  by  internal  members  of  an  organization  or  may  involve  a  third  party 
researcher-consultant.  Whether  internally  or  externally  managed,  a  similar  set  of 
questions  must  be  addressed  by  both  the  people  who  are  the  critical  decision¬ 
makers  for  proceeding  with  a  diagnosis  as  well  as  a  select  few  of  those  who  have 
the  most  informed  perspective  in  current  and  future  interagency  collaboration.  The 
goal  of  the  initiation  phase  is  to  uncover  several  issues:  the  relevant  background 
and  history,  the  motivation  for  the  effort,  expectations  for  the  diagnostic  process, 
specific  contextual  factors,  identification  of  the  counter-part  organizations  in  the 
collaboration,  the  scope  of  the  effort,  and  a  timeframe.  As  a  result  of  this  initiation 
phase,  there  should  be  a  determination  of  consensus  and  commitment. 

If  there  is  a  decision  to  proceed,  a  broader  set  of  key  informants  should  be 
identified  for  interviewing.  If  there  is  an  interagency  team  or  task  force  in  place, 
those  members  should  be  included.  Some  of  the  initial  “background”  questions  are 
outlined  in  the  “Interview”  section  of  the  discussion  of  the  “Collaborative  Capacity 
Audit”  below.  These  questions  would  be  included  in  the  initiating  discussion  with  key 
decision-makers  described  above.  They  could  also  be  used  as  part  of  the  data 
gathering  from  the  key  informants  who  have  been  identified  to  assist  in  the  design  of 
a  uniquely  tailored  audit  instrument. 

Planning  and  Design  of  Assessment  Procedures 

Discussions  with  key  leaders  addressing  the  issues  identified  above  establish 
the  groundwork  for  the  development  of  a  specific  diagnostic  plan.  The  first  step  in 
the  plan  is  the  determination  of  who  the  planning  team  should  be.  If  the  diagnostic 
design  is  largely  in  the  hands  of  researcher/consultant,  the  participating  organization 
will  decide  the  extent  to  which  it  wants  to  leave  the  design  to  these  external  experts 
or  be  actively  involved  in  the  decision-making.  At  a  minimum,  a  liaison  from  within 
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the  participating  organization(s)  should  be  identified  to  interface  with  the 
researchers/consultants. 

The  diagnostic  plan  should  begin  with  the  identification  of  diagnostic  “targets” 
(French  &  Bell,  1999).  These  “targets”  include  systems  elements  of  particular 
interest  (e.g.,  strategy,  incentives,  lateral  mechanisms)  which  may  have  been 
identified  in  the  initial  entry  phase.  Others  may  be  identified  as  the  result  of 
interviews  with  key  informants.  Once  target  topics  are  identified,  specific  tailoring  of 
items  is  done  to  meet  the  particular  interests  of  the  focal  organization(s).  This 
includes  the  definition  of  interview  questions  and  survey  questions.  This  can  be 
done  in  an  iterative  fashion  by  conducting  some  preliminary  interviews  with  key 
informants.  The  results  of  these  interviews  can  then  be  used  to  define  and  refine  the 
questions  to  be  used  on  the  survey. 

Diagnostic  targets  are  not  only  topical;  they  also  include  the  identification  of 
personnel  (both  inside  and  outside  the  organization)  who  should  be  asked  to 
participate  in  interviews,  focus  groups,  or  by  taking  a  survey.  Because  these 
methods  all  provide  data  of  a  different  sort,  people  can  be  asked  to  be  involved  in 
more  than  one  of  the  assessment  processes.  Most  important,  however,  is  that 
sufficient  participation  is  included  to  provide  a  valid  assessment  of  the  collaborative 
capability  of  the  system  (organization  or  set  of  organizations)  of  interest.  The 
diagnostic  design  could  include  gathering  data  from  partner  organizations  about  their 
perceptions  and  experiences  regarding  the  collaborative  capacity  of  the  focal 
organization.  This  approach  poses  a  more  complex  design  and  analysis  challenge. 
But,  if  the  primary  interest  is  in  collaborative  capacity  in  the  context  of  a  given 
partnership  or  network  of  relationships,  then  this  should  be  considered. 

An  important  aspect  of  the  plan  is  how  the  organization  members  will  be 
informed  as  to  the  purpose  of  the  diagnostic  effort,  the  plan  for  giving  feedback,  and 
the  intentions  to  take  action  based  on  the  results  of  the  assessment.  It  is  important 
that  this  effort  be  publicized  well  in  advance  of  its  initiation  and  that  there  be  clear 
justification  presented  as  well  as  support  by  organizational  leadership.  All  of  these 
factors  are  critical  to  the  ultimate  validity  of  the  findings. 
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Interpretation,  Feedback  and  Action  Planning 

Once  all  of  the  assessment  data  have  been  collected,  they  need  to  be 
summarized  and  interpreted.  The  degree  of  involvement  of  the  focal  organization(s) 
will  vary  depending  on  the  agreement  established  at  the  initiation  phase.  There  are 
a  number  of  ways  this  can  be  approached.  The  external  researchers/consultants 
can  take  the  primary  responsibility  for  both  the  analysis  and  the  interpretation.  Or, 
they  may  prepare  the  results  of  the  analyses  for  presentation  in  a  feedback  session 
in  which  organizational  participants  are  actively  engaged  in  interpreting  the  findings. 
Because  the  external  experts  will  likely  bring  both  perspective  and  knowledge  of 
existing  research  related  to  effective  interagency  collaboration,  and  the 
organizational  members  bring  the  vital  internal  perspective,  a  process  that  engages 
both  groups  in  interpretation  can  be  the  most  productive.  If  a  joint  approach  to 
interpretation  is  taken,  one  decision  is  who  to  include  from  inside  the  organization. 
The  key  leaders  and  key  informants  used  in  the  initial  phase  of  the  effort  are  one 
possible  group.  They  could  prepare  a  summary  and  interpretation  presentation  to 
then  share  as  feedback  to  a  broader  audience  of  organizational  members. 
Alternatively,  a  more  inclusive  participative  process  could  be  used  to  involve  a  larger 
number  of  organizational  members  in  the  interpretation  of  the  findings. 

Regardless  of  who  is  involved  in  the  analysis  and  interpretation,  some  key 
questions  should  be  addressed.  How  well  does  the  assessment  of  collaborative 
capacity  match  what  has  been  identified  as  necessary  or  desirable?  What  areas  of 
the  systems  model  show  the  strongest  capability?  The  weakest?  Are  there 
noteworthy  differences  in  the  results  when  different  organizational  groups  are 
compared  (e.g.,  top  leaders,  middle  managers,  operating  core)?  Do  those  members 
of  the  organization  who  have  the  most  opportunity  to  interact  with  other 
organizations  assess  the  collaborative  capacity  differently?  How?  As  noted  in  the 
discussion  above  of  the  Rationale  for  Diagnosis,  these  questions  (and  others)  are 
necessary  to  the  next  phase  in  the  diagnostic  process — action  planning. 

The  key  question  being  addressed  in  interpretation”  is,  “What  do  the 
assessment  results  mean”?  In  action  planning,  the  question  is,  “What  do  we  do 
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about  it”?  The  organizational  members  engaged  in  action  planning  may  be  different 
(or  in  addition  to)  those  who  were  involved  in  the  interpretation.  It  is  important  to 
involve  members  in  deciding  what  action  to  take  if  their  commitment  or  capabilities 
are  necessary  to  the  implementation  of  the  action  plan.  Feedback  about  the 
diagnostic  process  should  include  not  only  the  results  and  interpretation  of  the 
assessments,  but  also  the  interventions  identified  as  part  of  action  planning. 
Ongoing  communication  through  the  implementation  of  action  planning  is  also 
important  if  the  diagnostic  process  is  to  contribute  broadly  to  organizational  learning 
(Downs  &  Adrian,  2004;  Senge,  1992  ). 

Method 

The  third  facet  of  organizational  diagnosis  identified  by  Harrison  (1994) 
concerns  the  assessment  methods  and  tools  used.  A  general  presentation  of  tools 
and  methods  has  been  integrated  into  the  discussion  above  of  the  first  two  facets. 
The  method  we  used  to  develop  the  specific  tools  presented  in  this  report  was 
initiated  by  a  study  we  conducted  with  agency  managers  concerned  with  inter- 
organizational  collaboration  related  to  homeland  security  and  defense.  We  also 
drew  on  the  extant  literature  to  develop  the  items  in  Appendix  A.  A  more  complete 
list  of  references  that  influenced  our  thinking  can  be  found  in  Hocevar,  Thomas  and 
Jansen  (2006).  The  section  below  presents  illustrations  of  the  detailed  material 
included  in  Appendix  A.  Our  intention  is  that  this  database  of  interview  and  survey 
questions  will  be  used  to  formulate  tailored  instruments  for  diagnosis  of  the 
collaborative  capacity  of  specific  organizations  or  inter-organizational  systems. 
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Collaborative  Capacity  Audit 


This  section  describes  two  data-gathering  techniques  that  would  be  used  to 
measure  an  organization’s  collaborative  capacity:  interviews  and  survey  questions. 

Interviews 

Researchers/consultants  who  enter  into  an  unfamiliar  organization  or  a  set  of 
organizations  need  to  understand  the  context  those  organizations  face.  In  the 
interagency  context,  they  must  understand  the  problem  context  that  brings  the 
organizations  together.  The  collaborative  capacity  model  emphasizes  the  centrality 
of  the  interagency  problem  and  the  organizations’  needs  to  eventually  negotiate  a 
common  understanding  and  definition  of  this  problem  and  their  roles  and 
responsibilities  in  addressing  it.  Understanding  this  context  requires  an 
understanding  of  the  interests  of  various  stakeholders. 

■  What  is  the  central  (initiating)  problem  or  opportunity  that  motivates 
interagency  collaboration? 

■  How  does  this  problem  create  the  need  for  collaboration? 

■  Who  are  the  critical  stakeholders,  and  what  are  their  stakes  in  this 
context? 

■  Who  are  the  key  informants  representing  each? 

■  What  is  the  degree  of  collaboration  required? 

■  What  type/kind  of  collaboration  is  required? 

■  What  are  the  primary  values  or  beneficial  outcomes  to  be  gained  by 
collaboration? 

Questions  such  as  these  would  comprise  the  interview  agenda  at  the  initial 
entry  phase.  If  researchers/consultants  are  involved,  they  would  pose  these 
questions  to  the  leaders  of  the  organization  who  are  both  in  the  best  position  to 
know  the  answers  as  well  as  responsible  for  the  decision  about  engaging  in  the 
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investment  of  a  diagnosis  of  collaborative  capacity.  If  an  organization  (or  set  of 
organizations)  is  considering  undertaking  this  effort  on  their  own,  these  would  be 
important  questions  to  openly  discuss  among  key  leaders  in  deciding  whether  and 
how  to  proceed. 

Once  there  is  a  commitment  to  proceed,  additional  key  informants  would  be 
identified  to  be  interviewed.  They,  as  well  as  organizational  leaders,  would  become 
the  data  sources  for  interview  questions  outlined  in  this  section  and  offered  in  further 
detail  in  Appendix  A.  In  the  course  of  asking  questions,  a  comprehensive  history  of 
the  firms  is  produced.  This  includes  a  better  understanding  of  their  history  of 
interagency  interactions  and  the  stage  of  development  of  their  relationships.  This  is 
partly  derived  by  looking  at  member  behaviors  and  interactions  (i.e.,  their  network 
ties): 

■  How  often  does  middle  management  meet  with  their  counterparts  about 
Interagency  (lA)  collaboration? 

■  What  do  they  discuss  or  do  when  they  meet? 

■  Do  lower-level  workers/first-line  supervisors  and  workers  for  the 
organizations  interact  with  each  other? 

■  In  what  context? 

■  For  what  purpose?  Do  they  build  team  relationships  and  joint  skills? 

A  critical  junction  in  developing  collaborative  capacity  occurs  within  the  lA 
team.  Many  questions  asked  of  partner  organizations  are  also  relevant  for  the  lA 
team.  Indeed,  a  majority  of  the  diagnostic  questions  with  respect  to  the 
"organization"  or  the  "people  in  the  organization"  could  be  rewritten  so  that  the 
referent  is  the  "lA  team"  or  the  "members  of  the  lA  team.”  Illustrative  items  that 
would  assess  specific  on-going  interagency  activities  include: 

■  Do  the  lA  team  members  have  the  authority  to  make  commitments  to 
decisions? 

■  Are  there  established  interagency  procedures? 
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■  What  assets — in  terms  of  people,  technology,  or  money — have  been 
dedicated  to  building  collaborative  capacity?  Are  these  commitments 
increasing  or  decreasing  or  remaining  stable? 

Two  points  should  be  emphasized  about  the  interview  questions.  First,  some 
questions  are  likely  to  be  asked  of  all  individuals,  while  others  are  targeted  to 
specific  individuals.  Thus,  all  individuals  might  be  asked  about  the  “nature  and 
effectiveness  of  communications,”  but  specific  questions  about  infrastructure  and 
physical  technology  (e.g.,  radio  frequencies,  wireless  networks)  would  be  asked  of 
specific  people  most  familiar  with  these  issues.  Second,  questions  might  be  asked 
in  the  context  of  individual  interviews  or  in  the  context  of  focus  groups,  depending  on 
the  design  decisions  made  by  the  client  organizations  during  the  initial  entry  and 
planning  phases  discussed  above. 

Additional  questions  are  listed  in  the  data  base  printout  in  Appendix  A: 
Diagnostic  Questions  for  Measuring  Collaborative  Capacity  in  an  Interagency 
Context. 

Audit/Survey  Questions 

Appendix  A  includes  a  wide  range  of  survey  questions  that  were  constructed 
to  fit  the  dimensions  mentioned  in  Phase  I  of  our  research.  Most  of  the  questions 
were  original  questions  written  by  the  three  authors  of  this  paper.  In  some  cases 
questions  were  adapted  from  the  following  source  documents.  The  database 
identifies  the  particular  items  that  were  derived  from  the  source  documents. 

Cisco’s  Net  Ready:  Net  Ready  (2000)  offers  1 1  guiding  principles  for 
developing  seamless  interactivity  for  the  e-conomy.  A  Net  Ready  Scorecard  allows 
organizations  to  test  their  “net  readiness.” 

Collaboration  Among  Federal  Agencies.  This  GAO  report,  Results- 
Oriented  Government  (2005),  offers  best  practices  in  the  Federal  Government  for 
enhancing  and  sustaining  collaboration. 
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Collaboration  Inventory  Thomas  (2002)  developed  a  questionnaire  for  a 
management  development  program  on  interagency  collaboration.  This  instrument 
was  adapted  from  Wilder  Foundation’s  Collaboration  Factors  Inventory. 

Collaborative  Advantage:  Hansen  and  Nohria  (2004)  surveyed  executives 
from  107  companies  to  determine  the  degree  of  collaboration  within  their  firms  and 
to  assess  whether  they  were  using  management  levers  to  encourage  collaboration. 

Collaborative  Capacity.  Foster-Fishman,  Berkowitz,  Loundsbury,  Jacobson, 
and  Allen  (2001),  surveyed  articles,  book  chapters,  and  practitioner  guides  to 
develop  an  integrative  framework  of  competencies  and  processes  needed  for 
building  collaborative  capacity. 

The  following  discussion  describes  the  six  categories  of  questions  that  align 
with  the  systems  model  in  Hocevar,  Thomas  and  Jansen  (2006).  This  model  also  is 
useful  in  thinking  of  the  dynamics  that  may  be  involved  in  building  collaborative 
capacity. 

Purpose  and  Strategy 

Purpose,  mission,  goals,  values,  and  a  “felt  need”  to  collaborate  provide  a 
foundation  for  such  items^  as: 

■  Interagency  collaboration  is  a  high  priority  for  this  organization. 

■  We  understand  the  benefits  of  collaboration  for  our  organization. 

■  Interagency  collaboration  is  a  high  priority  for  this  organization. 

■  We  understand  the  benefits  of  collaboration  for  our  organization. 

■  We  have  clearly  established  goals  for  lA  collaboration. 


^  Survey  items  are,  for  the  most  part,  constructed  with  a  Likert-type  response  structure.  An  example 
would  be  a  5-point  rating  scale  where  a  1  =  strongly  disagree  and  5  =  strongly  agree. 
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■  Our  organization  recognizes  the  importance  of  working  with  other 
agencies  to  achieve  an  outcome. 

■  We  have  clearly  established  goals  for  I A  collaboration. 

In  constructing  these  general  items,  other  related  items  were  created  that 
related  to  planning,  network  ties,  willingness  to  collaborate,  and  leadership: 

■  Other  agencies  are  identified  and  included  in  our  planning  process. 

■  Our  organization  has  a  strong  network  of  relationships  with  key  community 
leaders  and  policy  makers. 

■  Our  organization  is  willing  to  address  cross-agency  goals. 

■  Our  organization  is  willing  to  invest  in  cross-agency  goals. 

■  Our  organizational  leaders  often  meet  and  confer  with  the  leaders  of  other 
agencies  about  mutual  collaboration. 

■  Top  leaders  or  our  organization  are  committed  to  lA  collaboration. 

Collaborative  Structure 

Organizational  structures  focus  largely  on  the  roles  and  responsibilities  that 
facilitate  or  serve  as  barriers  to  collaboration.  Formal  control  mechanisms  and 
coordination  mechanisms,  including  authority  and  standard  operating  procedures 
are  within  this  domain  of  the  model.  Survey  items  to  assess  the  structural  domain 
of  collaborative  capacity  include: 

■  lA  team  members  have  sufficient  authority  so  that  lA  decisions  will  be 
implemented. 

■  Employees  up  and  down  our  chain  work  well  together. 

■  Our  organization  is  willing  to  adapt  procedures  to  meet  the  requirements 
of  other  organizations  with  which  we  do  lA  work. 

■  Our  organization  has  metrics  in  place  that  evaluate  the  organization-level 
costs  of  collaboration. 
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■  We  use  cross-functional  teams  to  solve  key  business  problems. 

■  Conflicting  organizational  policies  make  collaboration  very  difficult. 

■  In  this  organization,  we  know  our  lA  roles  and  responsibilities. 

Also  of  critical  importance  within  this  domain  are  resource  and  budgetary 
issues: 


■  Our  lA  efforts  have  been  very  successful  in  finding  and  capturing  available 
funding. 

■  Programmatic  efforts  to  develop  our  collaborative  know-how  and  skills 
receive  a  high  priority  for  funding  in  our  organization. 

Social  Capital  through  Lateral  Mechanisms 

In  the  case  of  collaboration,  there  is  a  special  focus  on  lateral  or  horizontal 
mechanisms  between  organizations;  these  serve  to  coordinate  through  mutual 
adjustment.  Lateral  mechanisms  can  be  formal  or  informal.  Note  that  the  emphasis 
is  on  mechanisms  between  organizations  that  develop  social  capital.  The  variables 
of  importance  that  are  reflected  in  these  items  include  network  ties,  information 
sharing,  flexibility  and  adaptability,  combined  training  and  familiarity  w\\h  other 
organizations,  and  technical  interoperability. 

■  Members  of  our  organization  have  a  good  network  of  relationships  with 
those  in  other  organizations. 

■  People  in  this  organization  invest  time  and  energy  in  building  professional 
relationships  with  those  in  partner  organizations. 

■  We  provide  access  by  other  agencies  to  information  we  have  that  is 
relevant  to  their  work. 

■  Our  organization  works  with  other  agencies  to  identify  lessons  learned  for 
improved  collaboration. 

■  Our  organization  is  responsive  to  the  requirements  of  other  organizations 
with  which  we  work. 
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■  Our  organization  invests  time  and  resources  to  become  familiar  with  the 
capabilities  and  requirements  of  our  partner  organizations. 

■  Our  organization  has  the  technical  interoperability  to  enable  effective  lA 
collaboration. 

■  Our  leadership  commits  their  time  and  our  resources  to  combined  training 
with  other  agencies. 

■  Our  organization  commits  human  and  financial  resources  to  training  with 
our  lA  partners. 

These  factors,  working  together,  can  become  internalized  into  a  culture  of 
collaboration: 

■  Our  organization  has  strong  norms  that  encourage  lA  collaboration. 

■  Our  organization  has  strong  norms  for  learning  from  others. 

Incentives  to  Collaborate 

Incentives  and  disincentives  are  extraordinarily  important  if  collaborative 
intent  is  to  be  translated  into  performance.  Incentives  serve  both  to  align  individual 
and  organizational  goals  and  to  encourage  inter-organizational  collaboration. 
Although  some  individuals  and  organizations  might  collaborate  because  it  is  “the 
right  thing  to  do,”  collaborative  capacity  is  reinforced  by  incentive  systems  that 
support  doing  “the  right  thing.” 

At  the  individual  level,  collaboration  is  enhanced  when  organizational 
members  perceive  that  it  pays  off  in  terms  of  career  outcomes.  If  the  time  and 
energy  individuals  spend  on  collaboration  is  piled  on  top  of  their  regular  duties  or  is 
viewed  as  less  than  legitimate,  individuals  are  effectively  punished  for  their 
involvement.  And  if  individuals  are  not  held  accountable  for  the  quality  of  their 
contributions,  then  the  process  of  developing  trust  and  confidence  among  key 
players  is  threatened.  Leadership  is  viewed  as  central  in  communicating  the 
importance  of  collaborative  actions  and  of  modeling  such  actions  themselves. 

■  Our  organization  rewards  members  for  their  lA  collaborative  activities. 
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■  Collaborative  work  is  acknowledged  as  a  legitimate  part  of  my  work  load. 

■  In  our  organization,  collaborative  activities  and  responsibilities  are  added 
on  top  of  our  regular  work  load. 

■  Collaborative  work  is  acknowledged  as  a  legitimate  part  of  my  work  load. 

■  Our  CEO  often  discusses  the  importance  of  lA  collaboration  with  others  in 
the  organization. 

■  Leaders  of  this  organization  clearly  value  lA  activities  and  reward  good 
work  in  that  area. 

At  the  institutional  and  organizational  level,  the  structure  of  incentives  can 
shape  and  possibly  determine  whether  organizations  frame  their  interactions  as 
collaborative  or  competitive.  Indeed,  some  organizations  have  to  overcome  a 
history  of  competition  while  others  have  no  such  burdensome  context. 

■  We  gain  discretionary  resources  because  of  the  cost-savings  associated 
with  collaboration  on  technology  and  equipment. 

■  A  significant  motivation  for  our  organization's  involvement  in  lA 
collaboration  is  the  opportunity  for  outside  funding. 

■  Our  collaborative  partners  often  view  us  as  competitors. 

■  Our  organization  is  free  of  competitive  rivalries  with  our  partner 
organizations. 


People 

Although  our  focus  is  on  collaboration  at  the  inter-organizational  level, 
collaboration  involves  people.  For  example,  the  capacity  of  an  organization  to  share 
information  also  depends  on  the  willingness  of  its  people  to  share  information. 
Adequate  structural  mechanisms  are  reflected  in  role  clarity. 

■  People  in  our  organization  are  unwilling  to  share  information  with  others. 

■  When  working  on  interagency  issues,  we  often  face  incompatible 
requirements  or  requests. 
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■  Our  organization  has  established  clear  performance  standards  regarding 
interagency  work. 

■  I  have  a  clear  understanding  of  my  responsibilities  relating  to  interagency 
collaboration. 

Macro-level  collaboration  ultimately  depends  on  the  perceptions,  motives,  and 
attitudes  of  individual  members,  including  trust  and  respect. 

■  Members  of  our  organization  are  motivated  to  work  with  people  from  other 
organizations. 

■  People  in  our  organization  have  a  positive  attitude  toward  collaboration 
with  other  organizations. 

■  People  in  our  organization  understand  the  benefits  of  collaborating  with 
our  organizational  partners. 

■  People  in  our  organization  tend  to  be  suspicious  and  distrustful  of  our 
partners  in  other  organizations. 

■  Members  of  our  organization  respect  the  expertise  of  those  in  other 
organizations  with  whom  we  have  to  work. 

Interagency  success  not  only  depends  on  motives,  but  the  training  and 
learning  experiences  shared  with  organizational  partners.  Abilities  and  skills  are 
necessary  to  translate  intent  into  action. 

■  I  have  had  experience  working  with  members  of  other  organizations  with 
whom  we  collaborate. 

■  I  have  participated  in  interagency  training  with  members  of  other 
organizations. 

■  Employees  from  our  organization  are  not  used  to  working  with  people  from 
other  organizations  and  find  it  hard  to  do  so. 
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Demographics 

Finally,  survey  items  need  to  be  tailored  to  fit  particular  organizations.  The 
typical,  minimal  set  of  demographic  items  includes: 

■  Age 

■  Gender 

■  Tenure  in  the  job 

■  Tenure  in  the  organization 

■  Level  of  education 

■  Job  characteristics,  such  as  managerial  vs.  non-managerial  or  military  vs. 
civilian. 
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Conclusions  and  the  Way  Forward 


Interim  Items  in  Need  of  Vaiidation 

The  concept  of  a  capacity  for  collaboration  is  a  metaphor  that  has  occurred  to 
many  theorists  and  researchers.  There  is  a  growing  body  of  literature,  and  there 
appears  to  be  some  agreement  that  topics  such  as  social  capital,  network  ties,  trust, 
and  incentives  are  critical.  The  major  need  identified  by  theorists  and  inductive 
researchers  (e.g.,  Bardach,  1998)  is  to  operationalize  the  overarching  concept  and 
contributing  variables.  To  systematically  understand  and  to  promote  more  effective 
collaboration  among  agencies  and  organizations,  an  audit  process  with  valid  and 
reliable  instrumentation  needs  to  be  created.  Generating  interview  questions, 
survey  items,  and  going  through  the  processes  of  refinement,  testing  and  retesting  is 
a  tedious,  time-consuming  job  requiring  field-based  data  and  critical  review  by  those 
with  expertise  in  this  topic.  The  interagency  level  of  analysis  means  that  the  variety 
of  possible  contexts,  forms,  structures  and  processes  is  vast.  An  audit  must  be  of 
sufficient  generalizability  that  it  can  be  conducted  in  a  wide  variety  of  contexts,  but  it 
must  be  specific  enough  to  provide  actionable  insights  to  organizational  leaders. 

The  items  in  the  database  in  Appendix  A  are  interim  items;  they  represent  a 
draft  of  work  that  needs  to  be  field  tested  and  refined,  a  process  that  requires  the 
authors  find  research  sites  and,  ideally,  research  partners.  While  many  of  the  items 
derive  from  existing  theory  and  our  Phase  I  research,  they  have  not  passed  through 
sufficient  empirical  hurdles  for  us  to  be  willing  to  endorse  their  validity  at  this  stage  of 
our  work.  Previous  experience  of  the  authors  with  survey  development  makes  us 
confident  that  some  items  that  look  excellent  will  need  to  be  revised;  items  that  look 
possible  will  turn  out  better  than  we  thought,  and  discussions  with  client 
organizations  will  result  in  new  items.  Thus,  the  tables  presented  in  Appendix  A  are 
presented  with  the  following  notice:  “This  database  and  its  items  are  an  interim 
version  of  an  ongoing  project.  Fieid  testing  wiil  begin  in  2007.  Piease  contact 
the  authors  for  more  recent  information  on  the  status  of  the  item  bank  or  to 
discuss  participation  in  fieid  testing.” 
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Assessing  General  vs.  Relative  Collaborative  Capacity 

This  phase  of  the  project  deliberately  focuses  on  the  assessment  of  general 
collaborative  capacity  or  what  might  be  called  “non-relative  collaborative  capacity.” 
We  do  not  focus  on  assessing  the  collaborative  capacity  revealed  in  specific 
organizational  relationships.  In  other  words,  the  questions  are  worded  so  that  they 
can  be  answered  without  reference  to  specific  other  organization(s).  This  is  not  to 
deny  that  the  capacity  (or  motivation)  to  collaborate  by  Organization  A  may  vary 
depending  on  the  specific  “partner”  organizations.  But,  our  working  assumption — in 
need  of  empirical  validation — is  that  individuals  can  indeed  assess  the  capacity  of  an 
organization  to  collaborate  with  a  generalized  “other.”  The  items  are  thus  written  to 
focus  on  the  generic  capacity  of  a  focal  organization  (or  a  focal  lA  team)  to 
collaborate  with  others.  Again,  empirical  research  is  needed  to  determine  how  far 
one  can  go  in  advancing  theory  and  better  practice  without  getting  into  the  specific, 
relative  relationships  among  organizational  pairs. 

We  believe  that  it  is  likely  that  a  focus  on  relative  collaborative  capacity  might 
reveal  that  organization  A  has  the  requisite  capabilities  to  collaborate  with  partner  B 
but  not  nearly  as  much  capacity  to  collaborate  with  partner  C.  As  with  people, 
organizations  may  not  be  compatible  with  one  another.  But  such  relative 
collaborative  capacity  is  not  reflected  in  the  wording  of  the  questions  in  Appendix  A; 
the  current  item  set  focuses  on  non-relative  collaborative  capacity.  However  specific 
instructions  can  be  inserted  in  the  design  of  an  audit  that  identify  target  “partner” 
organizations  that  should  be  considered  when  answering  questions  about 
collaborative  capacity.  This,  along  with  very  minor  modifications  of  question  wording 
would  allow  for  the  assessment  of  collaborative  capacity  relative  to  a  specific 
organization  or  set  of  organizations. 

Plan  for  Field  Testing,  Validation,  and  Theory  Deveiopment 

We  have  identified  potential  partners  who  are  interested  in  assessing 
collaborative  capacity,  and  we  seek  more  such  partners.  It  will  be  important  to  field 
test  the  instrument  with  organizations  that  are  in  different  developmental  stages.  In 
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other  words,  some  organizations  may  have  only  recently  initiated  the  process  of 
collaborating;  others  may  have  been  collaborating  for  some  time  but  face  the 
problems  of  institutionalizing  and  formalizing  the  process  so  that  it  does  not  depend 
on  key  individuals;  and  some  may  have  institutionalized  their  processes.  Different 
lessons  can  be  learned  in  each  of  these  contexts.  We  currently  seek  to  focus  on 
several  start-up  collaborations  in  the  context  of  Homeland  Security  and  also  on  an 
exemplary  success  story  that  has  been  well  institutionalized  and  is  more  relevant  to 
the  Acquisition  community. 

We  should  also  note  that  the  process  of  validating  items  and  constructs  is 
also  a  process  of  validating  and  elaborating  theoretical  constructs.  This  means  that 
the  nuts-and-bolts  process  of  revising  and  interpreting  items  through  field  testing 
itself  generates  more  coherent  and  useful  ways  of  thinking  about  the  capabilities  and 
capacities  of  interagency  collaboration.  For  example,  we  anticipate  developing 
some  preliminary  hypotheses  about  the  developmental  stages  of  collaborative 
capacity  as  we  begin  our  field  testing  work  with  organizations  that  have  different 
amounts  of  experience  with  interagency  collaboration.  We  also  expect  that  we  will 
begin  to  identify  somewhat  of  a  hierarchy  of  predictors  of  collaborative  capacity 
because  it  is  unlikely  that  all  factors  included  in  our  current  model  are  of  equal 
impact  in  influencing  collaboration.  As  we  proceed  with  our  research,  we  will  be 
developing  a  more  refined  diagnostic  process,  as  well  as  a  more  refined 
understanding  of  how  collaborative  capacity  develops  and  ways  it  can  be  fostered. 
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Appendix  1.  Database  of  Questions 

Please  contact  the  authors  of  this  report  to  obtain  further  information 
regarding  the  database  of  questions. 
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